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ABSTRACT 

During 1972-73, Project HEED {Heed Ethnic Educational 
Depolarization) involved 1,350 Indian students in 60 classrooms at 
Sells, Topowa, San Carlos, Rice^ Many Farms, Hotevilla, Peach 
Springs, and Sacaton. Primary objectives were: (1) improvement in 
reading skills, (2) development of cultural awareness, and (3) 
providing for the Special Education needs of Indian children. In this 
report, the evaluation design format used was the introduction of 
each objective and pertinent data, in the form of results, which 
verified whether the objective was achieved. Various tests were 
administered, among which were: the Distar Mastery Tests, Wide Range 
Achievement Test, and the Self-Appraisal Inventory. Some of the 
project's successes were: (1) development of cultural awareness 
materials by students, (2) expansion of Special Education services, 
and (3) considerable field trip participation at all sites. Included 
in the addendum of this report are the first and second quarterly 
reports, a special evaluation report, thoughts about cultural 
awareness, a listing of field trips taken, and a letter from three 
Albuquerque public school teachers. (NQ) 
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I. Introduction 

Project HEED, (HEED Ethnic Educational Depolarization), 
had a very difficult second year. 

The primary objectives of the project, specifically 
improvement in reading skills, development of cultural aware- 
ness, and providing for the needs of special education for the 
Indian children, were partially accomplished, but not com- 
pletely. 

Many reasons can be cited for the failure of the Project 
to accomplish all of the stated objectives, but two very 
fundamental factors stand out as paramount. The magnitude of 
the Project, with seven tribes, eight schools, and several 
different school districts does not lend itself to simple 
coordination. The implementation process is complicated by 
the vastness of the project, and the number of variables, both 
internal, and external, make control patterns difficult. 
Secondly, there is a major problem in project management itself* 
Public Law 92-318 (Indian Education Act) for example, provides 
for the establishment of an Indian Advisory Council on projects 
related to Indian Education. While HEED does have such a 
Council, their role remains unclear. During April 1973, for 
example. Federal sponsors from the U. S. Office of Education 
chose to exclude the Indian Advisory Council of HEED from major 
participation in planning for the future of the Project, an 
act which understandably upset the Council members. The ques- 
tion remains, "Who does manage Project Heed?" Is management 



vested in the Federal sponsor, the State Department of Edu- 
cation, the Superintendent at Sacaton, the Project Director, or 
vested in the Advisory Council? The Project Director, or in 
the Advisory Council? The Project Director during the second 
year was very confused about management roles, and it is felt 
that much improvement can be realized for the third year if 
this fundamental issue of organization for management is clari- 
fied. 

Notwithstanding the major problems cited in the previous 
paragraph, namely complexity due to multi-variables, and con- 
fusion over management roles, there were many positive con- 
tributions during the second year of HEED, These included: 

1. A comprehensive pre-service workshop which provided 
excellent tribal participation, 

2. Successful in-service workshops for Distar reading 
and OLP. 

3. Student participation in developing cultural aware- 
ness materials. 

U, Expansion of special education services. 

5. Considerable field trip participation at all sites. 

6. Addition of educational specialist to Project staff 
with corresponding improvement in frequency and 
quality of site visitations. 

7. Implementation of OLP at four sites with all but one 
classroom meeting criterion performance. 
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8, Greater interaction of State Department of Education 
with project. 

9. Delivery of educational materials to sites (though 
somewhat delayed) . 

10.. Dissemination of HEED activities via Newsletter, 
Title III meetings, etc. 

11. Provision for evaluation design with specific control 
groups. 

12. Selection of a qualified educational program auditor. 

13. A functioning Indian Advisory Council with good repre- 
sentation from the sites and with positive leadership. 

14. Continued success with Distar programs insofar as 
meeting Distar objectives. 

15. Excellent use of community resources for providing 
enriched , culturally significant educational exper- 
iences. 

16. Successful implementation of a Reinforced Requisites 
Readiness program at the first grade, Sacaton, with 
significant improvement on the part of these children 
in attitudes towards school. 

17. Useful process evaluation in reading through the 
mini-reading tests. (These apply only to sites who 
used these instruments . ) 

18. Successful accomplishment of the program objective 
relating to improvement of basic skills for S/E 
children. 



3 



Unfortunately 5 project management was only partially 
effective in articulating the positive contributions of the 
Project. From a negative standpoint, these points were 
noted: 

1. Interpersonal relations between the Project Director 
and her immediate supervisor and other superiors 
were detrimental to the best interests of the 

Proj ect . 

2. Specific behavioral outcomes in reading were not 
accomplished . 

3. Program effects became almost invisible due to the 
multi-variate conditions. There were 27 separate 
categories of programs operating at Sells, for 
example . 

4. Teacher effects rather than program effects seemed to 
dominate the learning activity where such control 
patterns existed to allow such a determination (i.e. 
Many Farms ) . 

5. The children at Many Farms, who probably had the 
greatest need for OLP due to their cultural background, 
were not able to participate in OLP because of sub- 
stitute teacher problems at that site. 

6. Project management failed to interact sufficiently 
with the sites during the first half of the year. 
Classroom observations were minimal. 
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7. Tight inventory controls on HEED materials were 
lacking . 

8. Federal sponsors failed to recognize the intense 
feeling of pride which the Indian people have in 
their status as Indians and in their desire to have a 
strong voice in the management of education for their 
children. Tactful suggestions to the Federal sponsors 
that Indian participation at the special April meeting 
would be highly beneficial were essentially ignored • 

9. Distar materials arrived too late in the Fall, and 
several teachers abandoned the Distar program though 
project monies had been spent for their training. 

10. The cancellation of an Indian Advisory Council meeting 
by the Project Director in February, without any 
communication with the Chairman of the Council, was 
most abrupt, only increasing the concern in the mind 
of the Chairman of ^^IVhat part do the Indians really 
have in this project?" 

11. While certain sites excelled in carrying out the 
basic evaluation design in the reading and cultural 
awareness areas, there was a noticeable lack of posi- 
tive approach on these components at other sites. 
Project management did not bear down hard enough to 
see that these activities were carried out. 
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12. Project management delayed in selecting a totally 
qualified consultant to assess the effectiveness of 
special education programs • 

13. Processing of voucher payments to community resource 
personnel were excessively delayed. 

lU. Management roles from the different echelons were not 
clearly identified. 

15. The participation of Hotevilla as a site for HEED 
during the second year was not resolved until late 
October 1972. A total of twenty (20) children were 
involved. From a practical standpoint, this repre- 
sents a token participation only and dilutes the 
efforts pf project management. 

16. Distance factors posed serious problems of coordina- 
tion with particular problems during winter months. 
The staff was too thin to provide statewide coverage. 

17. Field trips were not conducted on an equitable basis. 
Some sites got more than others, on a pro-rata 
basis. 

II. Scope of Project and Rationale 

The second year of the Project evidenced an increase of 
participating ch5.1dren from a 1971/1972 level of approximately 
1000 to a 1972/1973 level of approximately 1350. 

The increases were the result of additional special 
education classes at Sells, Sacaton and Topowa, plus a second 
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kindergarten class at Sa,ca,ton, plus several graded classrooms 
at Sells. In terms of classrooms, the project expanded from 
48 classrooms to 60. (These data include special education 
classrooms. ) 

By sites, these classrooms were distributed as follows: 
Project HEED Classrooms/Children 



Site 


Number 


Children 


Sacaton 


12 


262 


Sells 


11 


2nn 


Peach Springs'"' 


9 


137 


San Carlos Rice 


9 


213 


Topowa 


8 


211 


Many Farms 


5 


169 


St. Charles Mission 




95 


Hotevilla* 


_2 


20 




60 


1,351 



*At Peach Springs, grades 7 £ 8 combined in one room. 
At Hotevilla, grades 4 & 5 combined in one room. 
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Rearranging these data to identify the participation 
by grade level* 

Project HEED Classrooms /Grade Level 



Grade 


Cl'as'srooins 


Number 


Kindergarten 


Q 
0 


ZXO 


XSl 


►7 

( 


10'+ 


£ i l\JL. 


7 


X o u 


3rd 


6 


138 


4th 


7 


168 


5th* 


6 


149 


6th 


6 


133 


7th 




88 


8th 


V 3 


80 


Special Education 


_6_ 


66 




60 


1,351 



The expansiveness of the project is best appreciated by 
locating the sites on a map of Arizona. The map further 
identifies each site with its tribal affiliation. Distance 
factors continued to present major problems for the staff. 
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During the second year, HEED initially had seven general 
objectives. These were: 

1. improvement in reading skills in all regular class- 
rooms (5M" classrooms K-8), 

2. improvement in basic skills of reading, spelling and 
arithmetic in the special education classrooms (6 
classrooms), 

3. improvement in oral proficiency skills in selected 
classrooms at Peach Springs, Sells, Sacaton and 
San Carlos, 

improvement in self-concept as related to school 
attitudes and motivation for school tasks, 

5. improvement in teacher awareness of Indian cultures 
and value orientation systems, 

6. increased participation on the part of parents in 
project related activities, 

7. development of a total special education program 
including referral and diagnostic services. 

For convenience, the general objective relating to OLP 
was subdivided into two program objectives, one for the 
regular classroom students and one for special education student 

It is important to stress that the Project, with con- 
currence of the Indian Advisory Council, had three basic goals 
in Indian Education: The improvement of reading skills, the 
encouragement of cultural learnings, and the identification and 
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remediation of problems in specie,! education. The program 
objectives were designed from these basic program goals. At 
the special Council meeting held in Phoenix in December 197 2, 
it was agreed by all parties that these goals remain. 
Interestingly enough, when the Federal sponsors held the 
''restructuring" meeting in April 197 3 , it was again agreed by 
those present that the basic goals for the project include 
reading improvement, cultural awareness, and special educa- 
tion services* 

A brief discussion of the rationale for these three pro- 
ject goals will follow* That all parties have reached con- 
sensus on these project goals should make for a smooth transi- 
tion for the new Project Director as the third year commences, 
assuming that the aforementioned problems of complexity and 
management are resolved. 

Reading 

One of the more serious failings of our educational 
system is that there is a tendency to generalize from 
middle class standards and attempt to make inferences 
about minority groups. 

For example, the middle class view is that nearly 
all children come to school wanting to learn to read. 
It is further assumed that the child who fails to learn 
to read will develop emotional reactions which become barriers 
that further complicate and impede the learning process. 
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Finally, it is argued that children who fail at reading 
develop numerous symptoms which reflect their difficulty 
and enable teachers, specialists and counselors to identify 
them quickly. All of these assumptions have middle 
class ties. 

For the Indian child not being able to read may be 
internalized as normal behavior. Many of his friends, 
and many of the adults whom he respects and admires either 
cannot or do not read* Lack of reading ability does not 
cut this child off from normal social activity since his 
peers may also be poor readers. 

Another important point is that the Indian child is 
less verbal than his Anglo counterpart. He is less 
fluent in all areas of language, less aware of what 
reading is all about and consequently, much less strongly 
motivated toward improvement in reading* 

Notwithstanding the usefulness of standardized 
achievement tests, it just does not make any sense that 
the behavioral outcomes in reading impose goals which 
are simply unrealistic. The only thing that makes sense 
is to state the behavioral outcome in such a manner that 
it directly relates to what might reasonably be expected 
in growth under normal conditions. If reading achieve- 
ment, appropriately measured, is above and beyond that 
which could be expected under normal conditions, then 
the program must be considered successful. 



The evaluator feels the current Arizona legislation 
requiring third graders to read at grade level is most 
unrealistic when applied to the .typical reservation Indian 
child in that it imposes a goal which is beyond the 
capacity of that child. Hopefully this will not lead to 
situations where first grade teachers are pushing children 
too fast through reading readiness into beginning reading. 
Research studies point out that regression often results 
in such cases. 

Those responsible for the planning and implementation 
of Project HEED are to be complim'ented in their priority 
concern for the improvement of reading. There is no 
question about the need» Nonetheless, good judgment and 
careful reflection of the background of the child are 
essential in designing the behavioral outcomes and in 
evaluating progress. 

It was precisely for these reasons that , the mini- 
reading instruments were developed. These tests provide 
the child with a successful experience in a reading task 
and have cultural relevance. Similarly, the Distar- 
Mastery Tests provide direct assessment of the Distar 
reading programs and represent a valuable evaluation tool. 

Cultural Awareness 

There is concern among Native Americans that many of 
the cultural aspects are in danger of being lost due to 
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the effects of expanding technology and its Anglo domina- 
tion. That written language patterns have been almost 
non-existent for the Native American increases the 
possibility that cultural influences may some day be 
lost. Skills of craftsmanship handed down from generation 
to generation are not practiced to the same degree as they 
were in the past. For example, in Arizona in most tribes 
virtually every woman was a basketmaker a century ago, 
the current number of basketweavers is estimated at no 
more than a hundred • 

Tribal elders and community leaders have made a posi- 
tive contribution to Project HEED through activities 
involving cooperative efforts with the school authorities 
which would enable the children to become more knowledge- 
able of their cultural heritage. The assistance which 
the Indian Advisory Council can offer to Project Manage- 
ment in this vital program goal area is obvious. 

A related aspect of the importance of this program 
goal is the development of increased understanding on the 
part of teachers and other educators of the value 
orientations and need dispositions of the Pndian children. 
The degree to which the child perceives the teacher in an 
affective manner strongly influences the learning process. 
The Indian child is very much aware of his status as an 
Indian, and is on the alert for any reaction, particularly 
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any note of disapproval or reservation in accepting him 
or his culture. He is quick to reject a teacher whom he 
feels does not like him. 

Special Education 

Section 306 of Title III requires that at least 15% 
of the program be allocated to Special Education needs. 
The recent Pennsylvania Supreme Court decision places 
responsibility on the State for providing education 
services irrespective of the nature of an individual's 
handicap. 

Research studies on Indian population have borne out 
the fact that there is a greater need per capita for 
special education services with Native Americans than 
with any other group in our society. For example, it 
is known that prenatal and post-natal care are important 
factors in the prevention and early detection of mental 
retardation. Services of this type are extremely inade- 
quate with reservation Indian communities. 

The State Department of Education, Arizona Division 
of Special Education has worked with HEED sites, in 
efforts to identify via teacher ratings those children 
who may exhibit behaviors which would suggest that they 
need help through special education services. 

During the second year, about 5% of the project 
children (66 of 1350) were assigned to Special Education 
classes. 
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III. Evalua^tion 

This section of the report will follow the format of the 

evaluation design* Each program objective will be introduced 

and pertinent data in the form of results will be presented 

to verify whether the objective was met. 

The pre-audit critique dated September 1972 suggested 

modifications in criteria for performance objectives, and 

recommended a reduction in the total testing plan. The Project 

Director revised the program objectives, and some of the 

testing was cut back* The objectives as stated in this report 

reflect the revisions in the evaluation design. 

A. Program Objective (Reading Improvement) 

Regular classroom students at each target site, 

through the use of selected reading materials (Distar 

in grades K-3; Field Enterprise in grades 4-8) will 

improve reading skills by demonstrating a mean grade 

equivalent of 1,0 during the project year, as measured 

by appropriate Standardized Achievement tests. 

1. The Wide Range Achievement Test was used on a 

pre/post basis to assess this objective for 

kindergarten and first grade respectively. 
Results are reported in Tables I and II. 
These conclusions are drawn from Table I: 

a. Mean post-test scores reflect that in all 

kindergarten classrooms, both experimental 

and control, the children show reading 
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readiness patterns corresponding to or above 
grade level . 

b. In tV7o project classrooms: , the criterion 
of 1.0 gain in grade level was met. One 
was a Distar classroom, one was a non-Distar 
classroom. In six (6) classrooms, the 
criterion was not met. 

c. In two classrooms, kindergarten children 
were actually at first grade level, again in 
one case a Distar classroom and in the other 
a non-Distar classroom. 

d. There appears to be no difference between 
Distar and non-Distar insofar as results are 
concerned. 

In making this judgment, it is recognized that 
the WRAT calls for identification of alphabet 
letters in the reading readiness sub-test. Distar 
training places low priority on letter identifi- 
cation per se, concentrating on sounds. For this 
reason, kindergarten children in Distar classrooms 
may be performing better than the WRAT data indi- 
cate. 

These conclusions are drawn from Table II: 
a. Mean post-test scores in all first grade 

classrooms, both experimental and control, 

are at or above grade level. 
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b. One control classroom exhibited a gain of 
1.3 grade equivalents between pre and post. 

c. None of the Project classrooms achieved the 
required criterion though all showed a gain 
of at least 0.5 grade level equivalents. 

d. Two classrooms, one Distar and one non- 
Distar, experimental and control respectively, 
showed mean post-test scores at the second 
grade level. 

Again, there is no apparent difference in com- 
paring Distar versus non-Distar classrooms . 

3. Tables III, IV, and V report results in reading 
achievement for the second, third and fourth 
grades respectively. 

4. The instrument used in this assessment was the 
SRA level, reading comprehension and read- 
ing vocabulary. The instrument has a lower 
limit. grade equivalent of one minus, and an 
upper limit of six plus. Total reading is 

the summation of comprehension and vocabulary. 

The following conclusions are drawn from Table 
III: 

a. In five out of seven project classrooms, 

the mean post-test scores in total reading 
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for 2nd graders reflect that the children 
are reading somewhere in the grade level 
range. At the other two project classrooms, 
these scores reveal children are behind 
grade level in total reading, 

b. Gains in reading skills were evidenced 

in all classrooms, experimental and control, 
excepting one. No significance is attached 
to this exception since this class through 
a mutual misunderstanding between testers 
and teacher was not pre-tested according 
to schedule . 

c- One classroom met the criterion stated in 
the performance objective. This classroom 
had lower entry behaviors. 

d. There is no difference between experimental 
and control, or between Distar and non- 
Distar . 

These conclusions are drawn from Table IV.. 

a. In two out of six project classrooms at 
third grade level, the mean post-test 
results for total reading indicate these 
classrooms are at grade level. In the 
other four project classrooms, the same 
scores reflect that the classrooms are 
reading below grade level. 
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b. One classroom met the criterion at this 
grade level. Five classrooms did not, 

c . Gains were registered in all classrooms 
excepting one . 

d. There is essentially no difference in 
Distar/non-Distar classroom performance 

or betvjeen experimental and control class- 
rooms . 

These conclusions are drawn from Table V: 

a. None of the fourth grade classrooms, experi- 
mental or control, was reading at grade 
level at post-test time, based on mean 
score results in total reading, 

b. None of the classrooms met the criterion 
called for in the perforinSnce objective. 



c. The very low number of children in the 

Hotevilla classroom (six 4th graders makes 



site) . All other classrooms showed some 
gain, however modest, in total reading. 
Tables VI - XI report results in the reading 
achievement area for grade levels 5th, 6th, 
7th and 8th respectively. 

The assessment instrument used was the SRA multi 
level (Blue), which measures comprehension and 




statistical inferences meaningless at that 



vocabulary. Total reading is the summation of 
these two components. The instrument has a 
lower limit of 3,1 grade equivalents, and an 
upper limit of 11,1, 

These conclusions are drawn from Table VI: 
a. Mean post-test results for fifth graders 
in total reading indicate that no class- 
rooms , experimental or control , were 
reading at grade level, 
br One project classroom was reading at Uth 
grade level. All other project classrooms 
were at least one full grade level below 
normal grade level, 

c. The regression at Hotevilla is meaning- 
less, again because of the small sample 
size , 

d. The" instrument was not an appropriate 
measure in at least two classrooms where 
the mean scores "bottomed outc" 

e. No classroom met the, criteria performance. 

These conclusions are drawn from Table VII: 
a. Mean post-test results in total reading for 
6th graders indicate that one project class- 
room was reading close to grade level, 
while the other five project classrooms were 
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reading at least one full grade level below 
normal. The very low number of students in 
the one classroom prevents any meaningful 
inference . 

b. None of the classrooms met criterion per- 
formance. 

c. The results at Sacaton should be viewed with 
caution. In the case of this classroom, 

it was noted that only a few students 
finished the test, the majority answering 
somewhere around 30 of the 92 items. Check- 
ing back with the teachers who administered 
the test (a group of Albuquerque Public 
School teachers assisted in test adminis- 
tration) gave no indication why these 
children failed to complete the test. The 
Project Director should attempt to ascertain 
from the Sacaton teacher what might have 
happened. In all probability results from 
this class are invalid. 

The following conclusions are drawn from 
Table VIII: 

a. Mean post-test results in total reading for 
seventh graders indicate that all project 
classrooms are at least two years behind 
grade level in reading. 



b. One of the four project classrooms met 
criterion performance . 

c. All of the classrooms registered gains. 

The following conclusions are drawn from 
Table IX: 

a. Mean post-test results indicate that the 
eighth grade classrooms were from two to 
three years behind grade level in reading. 

b. One of the four project classrooms met 
criterian performance . 

c. All of the project classrooms registered 
gains. 

7. Table X summarizes the total post-test results 
for the project in reading. The data in this 
table provide project management with adequate 
base-line assessment and point out the gradually 
widening gap between grade level performance 
and grades as the child progresses through 
school. There were minor changes in project 
enrollment between pre and post-testing. 

The summary statement based on data contained in 
Tables I thru IX is that the performance criterion 
for the program objective in reading was not met. 
It is suggested that project management consider 
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a downward revision of the performance ci'iterion 
using the data in Table X as a reference. 

8, Distar Evaluation--Students in grades kinder- 
garten thru third grade were given the appro- 
priate level Distar Mastery Test at post- 
testing time to determine if the specific 
learning objectives of the Distar Reading 
Program had been met. It must be understood 
that these tests are criterion referenced 
and are designed to assess only the objectives 
of the Distar reading program. 

Prerequisite minimum number of completed lessons 
for taking the Distar I level test is 90; for 
the Distar II level, 200, 

While there are packaged Distar III materials, 
there is no Mastery Test available from the 
publisher for this level. 

The tests are conveniently broken down into 
three sections, of equal number of items, A, 
B, and C. Distar I Mastery Test has 12 items 
in each Section, Distar II has 15 items. Thus 
a total maximum score for* these instruments 
is respectively 36 and 45 » 
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Satisfactory test performance was set at 7 5%. 
A child who scored nine (9) or better in any 
section of the Distar I test, for example, made* 
a satisfactory score. 

Table XI reports the summary results of the 
Distar Testing by classroom, showing number of 
students tested, number who performed satis- 
factorily in each section of the test, and 
the percentage of the class who scored satis- 
factorily in each section. Item difficulties 
progress from sections A to C. 

The following conclusions are drawn from 
Table XI: 

a. The greater the number of Distar lessons 
a child has experienced, the greater his 
likelihood of achieving a satisfactory 
score on any section of the Distar Mastery 
Test. 

b. The percentage of satisfactory scores on 
the ''A" portion of the Distar Mastery 
Tests, irrespective of level, attests to 
the fact that the objectives of the Distar 
Reading program were met during the project 
year. 



c. Comparing the results of Distar testing 
as shown in Table XI , with the results 
of the achievement tests in reading for 
corresponding grade levels^ reported in 
Tables I, 11, III, and IV respectively, 
it may be stated that: 

(1) There is no evidence that Distar 
training influences scores on the 
Wide Range Achievement Test (Pre- 
reading section). 

(2) There is evidence that the more satis- 
factory level of performance on Distar, 
the better the performance in total 
reading on the SRA 2-4 level test. 

The second grades at Many Farms and 
Sacaton, and third grade, St, Charles 
Mission, are cited as examples of 
this evidence. 
There was an opportunity to examine Title I 
data furnished by the reading- specialist, 
Indian Oasis School District, to further sub- 
stantiate the statement that Distar training 
does not influence reading readiness. Kinder- 
garten classes at Sells and Topowa were 
administered the Gates==MacGinitie Reading 
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Readiness Test in May 1973. The test assesses 
listening comprehension, auditory discrimination, 
visual discrimination, following directions, 
letter recognition, visual-motor coordination, 
auditory blending, and word recognition. Children 
in Distar (one classroom out of five kindergartens) 
did better than the other children in the auditory 
blending category. This was the only category 
where the Distar children excelled. > The data 
reported by this testing are shown in Table XII. 
It appears that teacher effects have a greater 
influence on development of reading readiness 
skills than ) the program effects of Distar. 
10. During the project year, staff personnel from 

HEED visited sites and included formal classroom 
observations of Distar lessons as an integral 
part of the visit agenda. The Evaluator has 
reviewed 45 classroom observation reports pre- 
pared by three separate individuals. The specific 
teacher behavior which the Distar program calls 
for include focusing or gaining the attention of 
the student, modeling or demonstrating responses 
correctly, signaling or providing stimuli setting 
the occasion for the response, reinforcing and 
correcting. Based on a review of these classroom 
observation reports, there was never an occasion 
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Vv'hen a teacher appeared to have a problem in 
maintaining her behavior within the techniques 
specified for this highly structured program. 
Most of the data in these reports alludes to the 
affectivity relationship between the teacher and 
the micro-teaching group of children being taught. 
While the importance of the teacher/child 
affectivity relationship in resultant learning 
is appreciated , these classroom observation 
reports are not a constructive tool for evaluation 
since they do not, as written, discriminate the 
problem areas the Distar teacher invariably faces. 
Early during the project year, the Evaluator 
met with the State Department of Education 
Title III representative to discuss possible ways 
to tighten the design so that more valuable infor- 
mation regarding program effects would be possible. 

One suggestion was to attempt to construct a 
composite matrix of the many interactive influ- 
ences. Following this meeting, each teacher was 
requested to complete a routine form which asked 
such pertinent questions as: 

a. What other reading programs are you using 
besides Distar? Cor Field Materials) 
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h. How many minutes per week do you use this 
program? 

c. How many minutes per week are you using 
Distar? (or Field Materials) 

d. How many reading groups do you have? 

Of the 51 teachers who responded, there were 
only 13 who did not use some other reading pro- 
gram as a supplement to the basic program (Distar 
or Field) • 

The variations in other reading programs ranged 
from ultra-conservative sound/ symbol phonetic 
materials to the ultra-liberal language experi- 
enced approaches. Lippencott^ Reader's Digest, 
Harper and Row, Scott Foresman, Economy Series, 
MacMillan, SWRL and many others were being used. 
There is no way that one c^n isolate those program 
effects related solely to the HEED materials 
(Distar and Field Materials) insofar as these 
effects relate to improving reading skills in 
general. 

The most practical way of determining if a child 
can read is to give him an appropriate level book 
and let him read it. For this reason, the teachers ■ 
who have supplemented the HEED materials with 
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others deserve credit. In many visits to class-- 
rooms, it was noted how much the children enjoy 
taking a Scott Foresman series book, for example, 
to the visitor and reading parts of a story to 
him. The many combinations of reading programs 
present complications in evaluation which leads 
to the conclusion that teacher effects probably 
have more influence than program effects on 
improving reading skills. 

In reviewing the reports from the teachers, many 
commented on the late arrival of the Distar 
materials. Teachers at Sells, for example, gave 
up on Distar and got started on other programs. 
The exception was the kindergarten teacher. Pro- 
ject management should review its procurement 
function to ensure that materials are ready when 
the school year begins. One comment which came 
up again and again from the teachei-s related to 
the interests of the child, "We need more easy 
readers with settings in the West, preferably 
with Indian characters." 
12. Mini-Reading Tests — These instruments were 

designed to provide a process evaluation component- 
to the reading program in grades 2-8. Their 
construction was simple, containing vocabulary, 
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synonym and comprehension items which could be 
completed in 10 minutes* Pictures and stories 
were culturally relevant. The intent was to pro- 
vide a simple assessment which would give the 
child the feeling of success and happiness in a 
reading task^ in contrast to the frustrations 
that develop when taking a standardized achievement 
test in reading. 

Somehow, the use of these instruments was only 
partially effective. Project management did not 
bear down on the sites in getting these adminis- 
tered and returned in a timely manner so that a 
good process evaluation could take place. At 
Sells, for example, the Principal gave the evaluator 
the completed tests for the mid'-winter evaluation 
after post-testing was completed in Mayl Some 
of the sites were most prompt and efficient in 
this task. Topowa and St. Charles Mission were 
the only sites where all three forms of the mini- 
tests were administered and returned in time. 

Table XIII reports results of the mini-tests, 
where given, in mean raw scores. In a few cases, 
the final mini-test was administered, but results 
do not appear in Table XIII because of lateness 
in arrival of tests. The design of the tests 
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allowed for progressively increasing difficulty 
in, the inatruments , Mini 2 being slightly more 
difficult than Mini 1 etc. Three leyels were 
used, one for grades 2-45 o^i^ 5-6 , and one 

for 7-8. 

Using these same instruments as a process evalu- 
ation device in a Developmental Reading Program 
with 900 children at grade levels 3, 4, 5 and 6 
in Ysleta, Texas but where tight controls existed 
in terms of administering and returning tests in 
a timely manner, it was found that the instru- 
ments were good predictors of reading progress. 

Project management needs to decide what emphasis 
to place on process evaluation in reading. Either 
do it right, or skip the idea completely. 
B. Program Objective (Special Education) 

At the end of the school year, special education 
students will show improvement in each of the basic 
skills, i.e. arithmetic, spelling, and reading, as 
determined by individual scores on standardized 
achievement tests • 

1. It will be recognized that this program objective 
does not specify a criterion performance. The 
original objective stated an improvement of at 
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least 0.5 grade level equivalent in each basic 
skill area. The pre-audit critique suggested 
elimination of this arbitrary setting in view of 
the divergent disabilities among the special edu- 
cation students. This elimination was done in 
an effort to individualize the evaluation process. 
Another revision suggested by the auditor was 
the elimination of the SRA 1-2 group testing 
assessment* 

2. The Wide Range Achievement Test was administered 
to Special Education students on a pre/post basis. 
All three sections of the WRAT were used, speci- 
fically reading, spelling and arithmetic. 

3. Table XIV reports results of special education 
testing. 

These conclusions are drawn from Table XIV: 

a. The trend at all sites is one in improvement 
in basic skills as evidenced by gain scores. 
Accordingly 5 the objective in special educa- 
tion has been accomplished. 

b. The number of students a special education 
teacher can effectively work with is limited. 
The teacher at Topowa, for example, needs 
more time to individualize the program. 
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c. Gains appear to be stronger in X'eading and 
arithmetic than in spelling . 
4. It is recognized that many of the special edu- 
cation students function in regular classrooms for 
a large part of the school day 5 coming to special 
education only for some component of instruction 
(i.e. reading etc . ) . This practice . helps to 
prevent the isolation syndrome for these students. 
C. Program Objective (OLP) 

Regular classroom students in grades K-1 at Peach 
Springs, Kindergarten at Sells, special education at 
Sells, San Carlos, and Sacaton will demonstrate 
significant improvement in oral language proficiency 
skills, specifically vocabulary, pronunciation and 
sentence structure as a result of participation in 
the SWCEL Oral Language Program. 

1. The initial intent of the Project Director was to 
implement OLP at all sites, grades kindergarten 
and one. This effort did not meet with approval 
and the Project Director wisely revised the plan 
to include only those sites who wanted the OLP. 
Many Farms definitely wanted the program but 
could not find substitute teachers to take over 
the classrooms when the teacher training workshop 
for OLP was conducted in early October, 1972. It 
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is felt that the Project Director viewed the OLP 
as a vital component in reading readiness, for 
until the child has command of the spoken word, 
attempts to proceed with reading per se are 
doomed to fail. There is ample evidence to 
support the statement that many Indian children 
come to school with insufficient development of 
oral proficiency skills in English. The new 
Project Director may want to consider a review 
of the CLP implementation, in the light of the 
evidence of difficulty the children are experiencing 
in reading. 

2. While the stated program objective lacks a per- 
formance criterion, the term "significant" was 
defined in the evaluation design on the basis of 
student's entry behavior. A student with a low 
entry behavior would have to demonstrate more 
improvement via gain scores than a student with 
a higher entry behavior. 

3. Computer print-outs have been previously furnished 
project management, providing individual raw 
scores, diagnostic data, statistical treatment, 
and other information called for in the evaluation 
design. 
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Table XV summarizes the results of the OLP. The 
maximum possible score on the instrument (SWCEL 
Test of Oral English Production) is 226 points. 
Guidelines for interpretation of this instrument 
state in part :, 

a. A score of less than 100 indicates lack of 
understanding of English. (Child needs some 
structured OLF. ) 

b. A score between 100 and 13 0 indicates a weak- 
ness in English. (Child could be helped with 
structured OLP. ) 

c. A score above 130 indicates reasonable under- 
standing of English, a level of fluency where 
the child does not need structured OLP 

These guidelines, of course, must consider the 
standard error of the instrument. 

The following conclusions are drawn from Table XV 
and from the previously stated guidelines: 
a. The children at Sells (kindergarten) needed 
OLP and benefited substantially from it. 
Their gain scores were large enough that this 
class met the criterion specified in the 
evaluation design as ^'significant." 



b. Children at Peach Springs received benefit 
from OLP though their need for structured 
OLE is marginal. One classroom met the 
criterion, the other did not. In the case 
of the latter, it is not known how many 
lessons the children actually received. 

c. Special education children at all sites 
showed gains in oral proficiency skills. It 
is considered inappropriate to assign specific 
expectation levels to these children • 

The management of the OLP from the standpoint of 
the quality assurance was only partially effec- 
tive. Content tests were either not administered 
or not reported. The only known in-service 
meeting for OLP was held in late January by the 
Evaluator on a Saturday. Two of the six partici- 
pating teachers were in attendance. Details are 
contained in the special evaluation report (see 
Addendum) . Classroom observations on OLP were 
not reported. Thus, the process evaluation for 
OLP could not be done. 

Project management needs to show stronger support 
in the quality assurance function if the OLP 
program is to continue. 
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5. Project management should review the possibility 
of OLP with school officials at Many Farms. 
Some sampling with the test instrument might be 
done to ascertain the needs. The evaluator has 
a feeling that the youngsters who needed the 
program in most cases did not participate I 

Program Objective (Motivation) 

At the end of the school year, regular classroom 
students in grades kindergarten thru eight at each 
target site will show improvement in self-motivation 
as measured by self-appraisal inventories, school 
attendance patterns and achievement. An experi- 
mental program stressing innovative motivational 
techniques will be piloted in one lower primary 
classroom and one Junior High classroom at the 
Sacaton site. Motivational kits will be used in 
grades 3-8 as an integral part of the instructional 
process as a means of accomplishing this objective. 
1. In the auditor's pre-audit critique the matter 
of content validity for the- lOX instrument is 
discussed. These instruments were piloted with 
many Title III projects and Arizona was included 
as a pilot state. It cannot be stated that 
the instruments (primary or intermediate level 
of self-appraisal inventories), were piloted 
exclusively with Indian children. 



The primary level of the Self Appraisal instru- 
ment was adminictered on a pre/post basis to 
children of grade levels kindergarten thru third. 
This instrument assesses across four categories: 
peer relationship J family relationship > school 
relationship 5 and general self-image • Ten 
questions were selected, to which the child, 
responding anonymously, marked either "yes" or 
"no". The instrument was administered in a group 
setting by the regular classroom teacher. The 
ten questions were : 

a. Do other children like' you? 

b- Do you get in trouble at home? 

c. Do you like to talk in class? 

d. Do you wish you were younger? 

e. Do you let other children have their way? 

f. Are you important to your family? 

g. Do you often feel bad in school? 

h. Do you like being just what you are? 

i. Do you have friends? 

j • Does your family want too much of you? 

Each of these questions relates to one of the 
four categories, with a positive response being 
either "yes" or "no". The following logic 
applies: 



Question 


Category 


Positive 


a 


Peer 


yes 


b 


Family 


no 


c 


School 


yes 


d 


General 


no 


e 


Peer 


no 




Family 


yes 


g 


School 


no 


h 


General 


yes 


i 


Peer 


yes 


j 


Family 


no 



3. Tables XVI thru XIX report post-test results in 
terms of mean percentages of positive responses 
by grade level for each of the four categories 

of the instrument. In the interests of protecting 
the confidentiality of the data, sites have been 
coded in these tables. 

The Project Director has previously been furnished 
complete data on pre and post testing by site and 
grade level, and has been provided decoding infor- 
mation. Computer printouts summarizing these 
data have been delivered to the Project Director. 
'This applies to all grades levels K-8.) 

Appropriate conclusions appear imjnediately follow- 
ing the tables. One very significant result, a 
repeat from last year, is that children have a 
lower attitude towards school relations, from 
first grade on, than the other three categories. 

4. Data on experimental versus control classrooms 
from the Many Farms site have been delivered to 
the Project Director, along with appropriate 
conclusions « For obvious reasons ,* these data 
are not included in this report. It may be 
stated that the project classrooms gave some 
evidence of displaying more positive responding 
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than the control classrooms. It cannot be con- 
cluded, based on results of the self -appraisal 
inventories, that the project had any direct 
influence on these results . 

5. The intermediate level of the self-appraisal 
inventory was administered to grades U thru 8. 
Forty items were included in the inventory, with 
ten items each for the four basic categories of 
peer , family , school and general self-image . 
Students responded either "true" or "false" to 
the items where again, a response was either 
positive or negative. As in the case of the 
primary level, these tests were administered by 
the regular classroom teachers in a group setting 
with the students responding anonymously. 

6. Tables XX thru Table XXIV report results of the 
intermediate level SAI testing. Results are 
given in mean percentages of positive responses 
by grade levels and across the four categories. 
Appropriate conclusions appear immediately 
following the tables. Again, sites are coded 
to protect confidentiality. 

?• Table XXV reports the entire project post-test 
results according to grade level and should 
give pro j ect management excellent base line data 
to use for the final year. 
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8. The experimental first grade of Sacaton imple- 
mented the SWCEL Reinforced Reading Requisites 
program. This program provides tangible rewards 
for the children on a variable reinforcement 
schedule, gradually tapering off and substituting 
intrinsic values (social praise) as the sole 
motivator. The content of the program includes 
readiness areas such as left to right progression, 
aural discrimination , visual discrimination , 
assoo'iative vocabulary, listening, and numerical 
concepts. The classroom did show a substantial 
gain in school attitudes, based on the pre/post 
results of the self-appraisal inventory. The 
gain was not necessarily caused by the intervention 
of RRR, but since other first graders without the 
RRR program did not realize similar gains, there 
is the possibility that RRR influenced the results. 
In all probability, school attitudes for first 
grade children are predominantly influenced by 
the teacher, not by any educational materials. 

Data on attendance patterns for this class, in 
comparison to other first grades at Sacaton were 
requested, but not provided. The data are bound 
to be available, and it is suggested that project 
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management use attendance patterns as an addi- 
tional dependent variable for evaluating the 
effectiveness of this innovation. 
9. The Junior High School Motivational Experiment 
never got off the ground. The former Project 
Director was to work with the 7th grade teacher 
in designing some type of innovation but it just 
failed to materialize. One problem is the 
rotation of Junior High students from teacher to 
teacher. The influence of the HEED teacher is 
limited to a fractional period of the school 
day at this grade level at Sacaton, 
10. In conversations with teachers, the Evaluator 
found that the modification kits are not being 
used for the most part. The following is 
quoted from the auditor ^s interim report: 

"The behavior modification kits are probably 
the least used materials in the project. This 
is primarily due to a lack of understanding in 
their application or philosophical differences 
with the theoretical constructs. . ." 

Amen. Notwithstanding the intent of these kits, 

unless the teachers are motivated to use them, 

as a supplement to the many things a teacher does 

in establishing and maintaining a warm, affective 

interpersonal relationship with the children, not 

much is going to take place. 
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Project management is encouraged to provide some 
indoctrination to the teachers in the use of these 
kits. So far, the expense of these materials is 
unjustified. 

Frankly, the evaluator has grave reservations 
over buying motivation in any package form. 

In summary, the evidence presented substantiates 
a negative overall finding in this program 
objective area. Hard data furnished the project 
director adds specificity to this conclusion. 

Finally, this program objective did not spell 
out a performance criterion in terms of what is 
meant by ''improvement.*' The auditor did not 
comment on this weakness in the pre-audit critique, 
probably in view of the difficulty to come up 
with hard data in the affective area. Having 
furnished baseline data (see Table XXV) there 
should be no excuse for not developing true 
performance objectives with criterion levels 
specified in the final year of the project. 
Program Objective (Cultural Awareness) 
At the end of the school year, teachers, parents, 
students and others connected with project, manage- 
ment will have an increased understanding of the 



differences among the Indian cultures 5 and will have 
increased their knowledge of the understanding of 
each culture. Field trips will be taken from time 
to time, not only for enrichment purposes, but as 
a means of accomplishing this objective. 

1. The auditor, in the pre-audit critique, suggested 
that this objective be rewritten. as two perform- 
ance ob j ectives . The Pro j ect Director did this 
in the following manner: 

a. Teachers become informed about Indian cultures 
through monthly in-service programs which 
stress history, art, tribal customs, values 
and tribal life-style. (Teachers were- to 
write a critique of the in-service programs 
evaluating the assistance of the program in 
their professional preparation.) 

b* Students become better informed about Indian 
culture and history. Written pre and post- 
tests will assess learning in the areas of 
concentration. 

Again, these are somewhat general statements and 
not true performance objectives. How does one 
assess cultural awareness is a difficult question. 
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The auditor put his finger ^'right on'^ in his 

succinct statement in the interim report: 

"With few exceptions, personnel directly and 
indirectly involved in HEED get excited when 
cultural awareness in education is discussed. 
But application is something else." 

2. At the December meeting of the Indian Advisory 
Council in Phoenix, the Council unanimously 
approved that cultural awareness be one of the 
three major project goals. In anticipation of 
this action by the Council, the Evaluator brought 
to that meeting another SWCEL representative 
from the Division of Native Studies. This 
individual had served on many cultural heritage 
commissions and as a full Indian was eminently 
well qualified to work with the sites in develop- 
ing meaningful cultural awareness programs. The 
Council requested that this individual prepare 
some sort of guidelines which could be dissemi- 
nated to each site. Tribal leaders and school 
personnel would then use these guidelines as a 
model, but make appropriate modifications so 
that each site would have its own plan. These 
plans were to be reviewed at the January Council 
meeting scheduled in Topowa. 
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The addendum includes ^^Thoughts about Cultural 
Awareness" prepared by Mrs. Maudine Carpenter, 
the SWCEL representative assigned to this pro- 
gra,m area. Mrs. Carpenter reviewed site plans 
as these became available and had the opportunity 
to visit many of the classrooms. 

By March 1973, at the time of the Federal spon- 
sors meeting in Sacaton concerning the fate of 
the project, the cultural awareness program was 
well underway at most sites . 

Field trips constituted a major component of 
the cultural awareness objective. Two major 
questions come to mind: 

a. Are the field trips justified in terms of 
this project objective? (What is the purpose 
of the trip, its* educational value?) 

b. Were all project children treated fairly 
insofar as available resources for sponsor- 
ing trips? Was there an equitable distribu- 
tion of trips for each project classroom/site 
based on the number of children in the 
project at that site? 

The auditor, in the interim report, reported that 
in one instance, the field trips were the primary 



incentive to remain in the project. The evalu- 
ator has heard this same feeling expressed at 
several sites. 

Project management prepared a summary report of 
field trips for the project year. This report 
is included in the Addendum. Considering the 
rural backgrounds of the Indian children ^ it is 
assumed that each trip did provide a meaningful, 
new and enriching educational experience. Learn- 
ing occurs everywhere, not just in the classroom 
and children can learn from a variety of people, 
not just their teachers. With this in mind, the 
trips seem justified. 

The summary report describes 42 separate trips 
taken by a total of 1,585 children. It does not 
appear that the trips were distributed equitably 
around the sites according to number of children 
in the project. Sacaton, for example, had 
roughly 20% of the project children and had 40% 
of the tripsi (606 children out of tlie 1,585) 
One grade level at Sacaton had six field trips, 
while several project classrooms had no trips. 

Project management needs to review the entire 
operation of field trips so that these deficiencies 
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in planning are not repeated. One suggestion 
is to sub-allocate that portion of the budget to 
each site principal on the basis of number of 
children in the project. Approval could still 
be vested in project management and a fairer dis- 
tribution of trips should result. 

A final point on the field trips. The trips 
were not balanced throughout the year. A total 
of nine trips ^were taken during the first six 
months of the school year, the remaining 3 3 
trips were concentrated in the last three months. 
Fourteen trip;, were taken in May alone. 

4. Several excellent examples of constructive pro- 
jects in cultural awareness have materialized 
through the efforts of Project HEED. 

The sites at Hotevilla, St. Charles Mission, . 
Topowa and Peach Springs submitted well-designed 
plans for implementing this component into the 
instructional program. The plans developed at 
Hotevilla and St. Charles Mission were most 
comprehensive • 

The seventh grade class at San Carlos Rice 
produced a pamphlet on the history of the Apache, 
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This pamphlet was widely distributed and has 
received acclaim from very high sources in 
government . 

Kindergarten classes at Sacaton have been very 
active in learning about Indian culture. The 
March Newsletter HEED THE CALL features activi- 
ties of these classes. 

5. Throughout the Project, there are many examples 
of favorable interaction with the adult community 
in connection with constructive projects in 
cultural awareness. It seems that this component 
serves a most useful purpose in bringing the 
school and community together. 

The mechanics of reimbursement to these adults 
for their services to the Project, whether it 
is writing legends or teaching basketweaving 
seem unduly complicated. Delays in receiving 
payment for services have a demoralizing influ- 
ence, not only on the individual who performed 
the service but also on the administrator who 
arranged for the services. 

6. Teachers were supposed to prepare local tests as 
an objective measure of learning in the cultural 
awareness area. The test developed at Hotevilla 
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is well designed and is a valid assessment tool 
for thf2 cultural awareness component at that 
site. The evaluator has not seen any other 
test instruments developed at other sites. It 
is possible that project management has such 
tests and has analyzed results from testing. 

In summary, the general purposes of this 
objective have been met. After a slow start, 
cultural awareness activities developed on a 
planned basis at most sites. Many field trips 
were taken, and these seemed highly relevant. 
There is a management problem relating to pro- 
rating field trips equitably according to number 
of children at each site. Performance criteria 
for measuring accomplishment in this program area 
needs to be made specific. The high level of 
community involvement and attendant good publi- 
city which can result are plus factors. Local 
autonomy in developing activities was encouraged. 

F. Program Objective 

Special education students at each site are provided 
with referral, diagnostic services, and program 
development, implementation and evaluation services. 
Performance objectives are set individually for the 
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child by the Special Education teacher, the Special 
Education consultcmt, and by the Project Director. 
The Special Education consultant will perform a 
needs assessment at each site; i.e., locate and 
identify children with special educational needs, and 
provide reports to the principals at the sites, and 
the Project Director. In addition, the Special 
Education consultant will provide necessary services 
for the children identified, i.e. referral, diag- 
nostic services and program development, implementation, 
and evaluation services. 

1. During the Project Year, two special education 
consultants were employed to perform these tasks. 
The evaluator does not have any reports from 
these individuals and believes that consultant 
reports have been furnished to project manage- 
ment. 

2. In carrying out the plan, the importance of 
involving regular, classroom teachers in the needs 
assessment, and the close rapport with parents 
throughout the process, needs to be stressed. 

Project management had complete control of this pro- 
gram objective. Any statement of accomplishment 
must come from that source. 



G. Program Objective 

It is hypothesized that first grade children in 
Sacaton will have developed a more positive attitude 
toward school life as a result of participating in 
the learning experiences which are part of the 
Reinforced Readiness Requisites (RRR) program. 

Assessment of the children's attitude toward school 
was determined through pre/post administration of 
the self-appraisal inventory (primary level). Results 
have been discussed in Section D (motivation) of 
this report. This classroom made a substantial gain 
in the school attitude category and some of this 
gain may well be attributed to the RRR program. 

IV. Summary of Objectives and Accomplishment 

The following table summarizes the accompli i=!hment/non- 
accomplishment of program objectives for the project 
second year; 
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Re co'nunen'dat ions' to Project' Management 
The following recommenda.tions are intended to assist 
Project Management in rendering improvements to the 
project for the third year: 

A. At an early date get a clear cut policy statement 
which spells out management responsibilities at each 
level so that role functions are mutually understood. 
With such a statement as a base, a simple handbook 
can be prepared to provide the sites with "do"s and 
donHs" on all project matters such as materials, 
field trips, vouchers, etc. 

B. In collaboration with site people and with SDE, 
revise performance criteria downward in the case of 
reading. There exists ample evidence that a gain 
of one grade equivalency is unrealistic for the typi- 
cal child in a one year reading program. 

C. Continue Distar at grades Kindergarten-3 , where it 

is wanted, but encourage supplemental reading materials 
as well. Ensure procurement of Distar is on schedule, 
and attempt to devise a more meaningful Distar 
observation report. 

D. If a decision is made to retain a process evaluation 
component in reading (and- the data suggest such 

might be a wise plan) conduct a thorough indoctrination 
of site people insofar as their responsibilities are 
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concerned in administering the instruments on schedule, 
and in reporting results. 

E. Ascertain with Many Farms if they want OLP. Send a 
staff representative to SWCEL for QAS training (if 
OLP is to remain). 

F. Consider the expansion of the RRR to perhaps two more 
project first grades. 

G. Spread field trips throughout the year, and provide 
trip allocations on a pro-rated basis to the sites. 

H. Allow the Chairman of the Indian Advisory Council to 
function as the Chairman, setting time, place, 
purpose of meetings. Provide Chairman with a budget 
for these meetings. 

I. Include indoctrination of Field Enterprise Materials 
as part of workshop. 

J. Include indoctrination on Behavior Modification Kits 
as part of workshop. 

K. Tighten up inventory control of HEED materials. 

L. Attempt to develop simplified, streamlined voucher 
processing procedures • 

M. Continue site visitations on increased basis with 
emphasis on what the children are doing, 

Nr Provide Federal sponsors with early evidence of speci- 
fic areas LEA^ s are willing to take over as project 
completes third year. 

0. Strive to include the Indian Advisory Council .in 
important meetings. 
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APPENDIX A 



Quarterly Evaluation Report- Project HEED 



1. This report covers the activities of Project HEED during the 
quarterly period ending in September 1972. 



2. Several events of significance took place during the final months 
of the first year of Project HEED which influenced the activities 
of Project staff during the first quarter of the new school year. 
These included, among other things, the following: 

a. Dr. Eugenia Rothenberg was appointed as Project Director. 

b. The Project management met with HEW officials in 

San Francisco regarding new directions for the Project. 

c. Negotiations were begun to engage the services of a 
fully qualified educational program auditor. 

d. Advance copies of the pertinent sections of the final 
evaluation report, specifically reading results, were 
delivered to the Project Director so that formative 
planning of proposal rewriting could be accomplished 
on a realistic basis. 

3. The final evaluation report was delivered to Project management 
alongwith all individual test data in mid- July 1972. 

4. The major activities of the Project HEED staff during the month 
of July included: 



a. A review of the evaluation report and other reports 
provided internally from the Project for purposes of 
a formative nature in preparing for the new school 
year. 

b. Planning for a Project workshop. so that individual teachers 
and aides, as well as administrative levels at the school 
districts, could be better informed on the overall objectives 
and goals of the Project. This workshop was deemed necessary 
in that several echelons at the sites had expressed the 
feeling that they were not aware of the objectives or of 
the procedures through which the objectives were to be 
accomplished. Much of this communications gap is attributed 
to the fact that the previous Project Director resigned 

her position in late 1971, and the position remained unfilled 
until Dr. Rothenberg *s appointment in May 1972. 

(1) Project HEED staff contracted with Northern Arizona 
University, Flagstaff, for the workshop facility. 
Arrangements included dormitory, eating, meeting 
places and technical assistance. 



59 



(2) Project HEED staff coordinated program details for the 

11 day workshop stressing the areas of cultural awareness, 
reading, oral language program, motivation, reinforcement 
theory, behavior modification, and educational materials 
used in the Project such as Montessori, Distar and Field 
Enterprises. An impressive group of outside consultants 
were engaged to present various aspects of the technical 
program for the workshop. Scheduling allowed for optimum 
conditions in which workshop attendees could share Project 
experiences directly with one another. Separate conferences 
were planned to provide maximum opportunity for administrators 
and teachers to gain first hand knowledge on Project goals 
and objectives . 

5. The workshop provided the focal point of Project HEED activity during 
August. Project management had made extensive plans and all sites were 
thoroughly informed as to the purposes, planning and scope of the 
workshop. Actual attendance averaged between 60-70 participants on 
a daily basis. This figure represents approximately % of the teachers 
and teacher aides in the Project. Considering all of the factors 
which militate against attendance at summer workshops , (i.e . summer 
school, other employment, vacation etc.), the representation must 
be taken as a positive manifestation of interest on the part of the 
teachers and aides. 



(1) Project management is to be congratulated on a well 
organized and smoothly run workshop. 

(2) Outside attendees included the Chairman of the Indian 
Advisory Council to Project HEED, Mro Tony Machukay, 
the Title III Coordinator from the State Department 
of Education, Arizona, Dr. Deane Hurd, and a longtime 
proponent of bilingual education for Indian children 
in Arizona, Mrs Mamie Sizemore. The newly designated 
Project auditor , Dr * Jerry Southard , and the Project 
Evaluator, Dr. Orval Hughes, were in attendance at 
part of the sessions. 

(3) Project management obtained critique comments from 
the attendees. For the most part these comments were 
quite constructive and reflect the sincere interest 
on the part of the participants to see the Project 
become entirely successful. Naturally there were some 
criticisms expressed which were not positive, and ^ 
Project management has done an excellent job in reviewing 
all of the critiques with the intent of making modifications 
for the betterment of the Project. 

(4) The University of Northern Arizona provided outstanding 
support for the workshop. 

(5) Total workshop costs amounted to approximately $30,000. 
It is difficult to analyze the effects of the workshop 

on a cost/benefit basis. For the purposes of Project HEED, 
the workshop in August 1972 appeared quite necessary. 
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6, The major function of the Project HEED staff during September 
was to get the educational materials of the Project distributed 
to the sites, where necessary, and to actually conduct site visits 
meeting with superintendents, principals, teachers and community 
representatives so that a positive communications link would be 
established between the Project headquarters and the sites, 

(1) These visits to the sites provided the first opportunity 
for the newly appointed Project Director to interact 

at the site level. 

(2) Several newly hired teachers and aides had been unable 
to attend the Project workshop in August, and these 
visits allowed for these personnel to receive orientation 
about the Project. 

Plans were also made for special teacher training institutes, such 
as the OLP institute which was conducted at Sacaton in early October 



7. In summary, the activities of the Project staff during the quarter 
ending September 1972 were highly productive in terms of preparing 
the sites for the new school year. 



1972. 




Orval D. Hughes V 
Project Evaluator 



January 3, 1973 
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Quarterly Evaluation Report 
Project HEED 

1. Report Period 

This report covers the period October, November and December 1972 

2* The major components of this report include ; 

OLP Institute training 
Distar Institute training 
Pre-testing 

Project Staff activities 

Indian Advisory Council meetings 

Mini-reading implementation 

Plans for cultural awareness component 

Conferences with Superintendent and SDE personnel 

3. Narrative summary 

During this report period the Project Evaluator personally visited 
five of the sites , (Sells , Topowa, Sacaton, San Carlos Rice, St. Charles 
Mission, and Many Farms). While these visits were made in conjunction 
with pre-testing, there was opportunity to visit several classrooms and 
discuss the progress of the Project on an individual basis with teachers. 
Additionally, the Evaluator was able to bring in experienced educators 
from the Albuquerque Public Schools as part of their Title IV in-service 
training. These individuals, all veteran teachers, were thoroughly briefed 
on the Project goals and objectives prior to their site visits. Since these 
individuals were teachers they were able to communicate more easily with 
the Project teachers and report conditions more objectively than might be 
possible when such visits are made by superiors in the educational "chain 
of command''. 

The overall response from these visitations, done in connection vith the 
pre-testing, was highly favorable. A copy of a report from these people is 
enclosed. 

There were several problem areas which will be discussed in the following 
paragraphs. 

The general feeling is that the Project goals and objectives are understood, 
and that more responsibility for the implementation should be delegated to 
the site level. In this, sense. Project management might give consideration 
to devoting more effort to field visits and classroom interaction, and that 
a corresponding reduction in effort which might be counter-productive to such 
field visits is suggested. The importance of top-level management at Federal 
and State level . notwithstanding, the opinion of the Evaluator supported 
by the remarks obtained during site visits, is that the sites would like to 
have more freedom in making the Project ''go", and that this should be 
encouraged. 



ERIC 



63 



4. Each of the components will be discussed in the following sub-paragraphs. 

A. OLP Institute training 

SWCEL conducted a 3 day OLP institute at Sacaton October 2,3,4 1972. 
Mrs Ida Carrillo of the SWCEL staff coordinated the arrangements for 
faculty, technicians, equipment and institute materials. Mrs Charlie 
Mae Ipharr of HEED staff coordinated local arrangements for space, 
children etc. 

Participants included teachers from Peach Springs, Sells, Sacaton, 
and San Carlos. The number of participants was less than originally 
planned, and unfortunately there were no substitute teachers available 
in Many Farms so that those teachers might be trained to offer the OLP. 
There is no question about the need for the Navajo youngster who grows 
up on the reservation to develop his oral proficiency skills in English, 
since his language dominance as a 5/6 year old is in nearly all cases 
his native language. 

IXiring site visits, to Many Farms in November, the lower primary teachers 
and the principal expressed the hope that the children at kindergarten 
and first grade level at Many Farms might be included in the OLP, for in 
their judgment, such training is a first-priority. 

The 3 day institute provided the participants with the basic skills to 
begin teaching the OLP lessons. Mrs Ipharr received special training at 
SWCEL to serve in the role of Quality Assurance Specialist to provide 
accountability for the successful implementation of the program. The 
normal OLP institute requires a 5 day session, so it was agreed that 
SWCEL would provide additional teacher training at a later date to be 
arranged with the mutual cooperation of Project management and SWCEL. 
(This has been accomplished-a special OLP training meeting was held 
in January 1973) . 

While more related to pre-testing, the results obtained from the SWCEL 
Test of Oral English Production, administered in October 1972, clearly 
justify the need for some type of structured oral language activity for 
the children. As a parallel, oral skills must be developed before reading 
and writing can develop. The crucial need is at Many Farms. (As expressed 
by the teachers at that site). A major Project decision is to determine 
what to do about building up the oral proficiency skills of the children 
so that, complemented by reading readiness activities,, the early instruction 
in reading may proceed more successfully. Inputs from the teachers, some 
sample testing are suggested ways to arrive at a meaningful decision. There 
are several youngsters who need this help, and no doubt there are several 
who are reasonably fluent as 5/6 year olds and do not need the OLP. 

B. Distar Workshop 

Mrs Peggy Hostetler, former Project Director of HEED, presented a Distar 
workshop to selected teachers on October 5,6,7, 1972. Attendees came from 
Topowa, Sells, Peach Springs, San Carlos, Sacaton and HEED staff. Again, 
the problem of obtaining substitutes prevented representation from Many 
Farms. 
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A Lotal of 19 teachers and HEED staff personnel attended these sessions, 
which were designed both for beginning Distar teachers and those with a 
year or more of Distar training experience. Distar is the primary reading 
program in all sites excepting Topowa, for grades K-3. There is considerable 
enthusiasm on the part of the teachers for this program. The Distar concentrates 
on a sound and symbol attack of worrls, and the underlying rationale is that 
this type of highly-structured approach to learning reading skills is most 
appropriate for childen of diverse cultures. 

The ef f ec tivegiess of the Distar program will be measured by several 
techniques, include the use of Distar Mastery tests, (criterion referenced 
to the objectives of the Distar program), the control group at Topowa 
which is using SWRL reading materials at kindergarten and first grade 
level, the results of Wide Range Achievement testing for kindergarten and 
first grade youngsters, and finally the influence of Distar training 
versus no Distar training on results in comprehension and vocabulary skills 
as assessed on standardized achievement tests. 

Project stiaff personnel will be making classroom observations in the 
Distar classrooms on a regularly scheduled basis, and these reports will 
be reviewed in comparison with the results from the testing program. 

Again, from the results of pre- testing, it is clear that the Project funds 
expended in the development of the Distar reading program are well justified, 
for there is considerable evidence that the children are behind in grade 
leVel. 

The important matter which needs to be stressed is that the teachers are 
very pleased with the Distar program. Whatever the quality of an educational 
product, unless the classroom teacher has a sincere and positive attitude 
to work with the product, the implementation will not be successful. This is 
why it is so vital to the success of HEED to provide expanded opportunities 
for Project staff, evaluator and others to make frequent contact with the 
people at the sites. 

C. Pre- test ing 

Pre-testing was accomplished at intervals during October and November of 
1972. Efforts to coordinate testing dates, through the Project HEED office 
proved to be most effective so that testing was done with a minimum of 
confusion and at least interference with the other activities at a site. 
The cooperation received by administrators and classroom teachers was 
excellent. There are bound to be minor problems in arranging a satisfactory 
schedule, but all in all, the pre- testing went smoothly. 

Some criticism has been expressed by state and federal personnel that the 
design cal]s for "over- test ing*' . In terms of the individual child, the 
exposure to the testing, including the reading and the self-appraisal 
inventory, was less than 2 hours. Overall, for the entire Project year, 
an individual child would be engaged for not more than 5 hours in the 
testing program. That amount of time seems quite reasonable to the teachers, 
since it provides for all the process evaluations so vital for interim 
feedback. Younger children, kindergarten and first graders specifically, 
would not be engaged for more than 2 hours throughout the -testing year. 
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In view of the priority objective of the Project, namely the improvement 
of reading skills for the children, ( an objective firmly agreed upon by the 
Indian Advisory Council), it seems that some degree of assessment in the 
acquisition of reading skills is most necessary. 

Special consideration should be given in the testing program to the Many Farms 
site, which serves as a control at all grade levels K-5. Mr. Garcia and his 
teachers were most helpful to the evaluation personnel, who had the problem 
of administering over 500 tests in a two day period, including 175 individually 

administered instruments. 

'I 

One factor which came up several times during the pre- testing was that the 
HEED children are under the influence of several federally- funded programs. 
At Topowa and Sells, for example, the Metropolitan Readiness Test was being 
given to early kindergarten children as part of a Title I requirement. 
(This instrument is designed to measure readiness for first grade and the 
children were not at that point in their kindergarten year ready for MRT) . 
Now whBn the testing from these oJiier programs is combined with the testing 
from the HEED program it may well be that over- testing results. 

Hotevilla is another example of a site which is funded under separate BIA 
Title I grants. The problem of assessing program effects is complicated 
because of the interactive influence of different federal programs. There 
is a need for Project management to identify what these other influences are, 
so th6t the most meaningful findings can be detemined. 

Results from pre-testing were disseminated to the Project Director and to 
the site principals at the Council meeting in mid-December 1972. These results 
reported individual raw scores, grade equivalents and percentiles. Since that 
time, pre-test data have been furnished with mean scores by classroom, site, 
grade level. The Project Director and Evaluator have discussed the format for 
reporting data on several occasions. 

During the first year of the Project, there was an unpleasant situation which 
arose during the pre-testing, as reported by site personnel, including principal 
It was generally the result of inexperienced, young testers. To avoid any 
repdtition of this situation, SWCEL has provided a mature, veteran- teacher 
team for both pre-testing and post- testing. Five teachers from the Albuquerque 
Public schools fromed the nucleus of this team, which was supplemented by 
the Evaluator and Navajo leaders in te case at Many Farms. While the costs to 
provide this degree of experience, in terms of substitute coverage, travel and 
per diem, may seem excessive, it is the specific request of Project management 
and site personnel that this practice be continued. There is much to be gained 
in the validity of the test administration by this procedure. Then there is a 
corallary spin-off, to wit the HEED teachers have another teacher to talk over 
their problems with and vice-versa. That the pre-testing went smoothly is in 
part due to the greater experience level of the testers who were administering 
the tests. (See separate report from these testers). 

D. Project staff activities 

The November issue of the HEED newsletter summarizies many of the Project staff 
activities during the reporting period. These included participation at the 
Title III NASACC meeting in Scottsdale in late October, attendance at the 
NIEA meeting in Seattle in early November, a visitation by the Fe<ffleral sponsor 
in late November, conferences with State Department personnel, and preparations 
for the Council meeting in December. Additionally, the Project Director met 
in Albuquerque in late December with the Evaluator and with the SWCEL Indian 
Studies Division representative inconnection with the renewal proposal and with 
the development of a positive cultural awareness program. 
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E. Indian Advisory Council Meetings 



The October meeting had to be cancelled due to flood conditions in the 
Phoenix area following several days of rain. The Chairman of the Council 
suffered a personal loss in his family which necessitated the cancellation 
of the November me e t ing. 

The December meeting was held on schedule in the Arizona Power Commission 
offices in Phoenix on December 18th, 1972. Since this was the only meeting 
of the Council for the quarter, and since the agenda included the most 
important topic of gaining inputs from the Council for program redesign, 
the attendance was gratifying. All sites were represented excepting Peach 
Springs. The cross-section of attendees included Indian community .people , 
superintendents, principals, teachers, HEED staff, SDE, and the Evaluator. 
Mrs Maudine Carpenter of SWCEL, a member of President Nixon's cultural 
heritage Commission and a full Kiowa, was introduced to the Council and 
is the SWCEL designate for working with site personnel in matters of 
cultural awareness . 

The Council decided to concentrate in three main areas for the Project 
objectives as follows; 

(1) improvement in reading 
(including the OLP) 

(2) special education 

(3) cultural awareness 

The value of these Council meetings which provide the opportunity to 
share Project concerns with the Project management are readily apparent 
from the seriousness with which the discussions unfold. The impending 
legislation in the Congress , (Indian Self-De termination Act of 1973), 
would, if enacted, add significance and additional justification for 
the continued involvement of the Council as a group to make recommendations 
with Project management and to assist in formulating decisions affecting 
the children. 

Every effort should be made by Project management to encourage these 
Council meeting on no less than a monthly basis, with appropriate 
budgeting so that attendance is encouraged. 

While there are now a set of by-laws for the Council, it would appear that 
some type of smooth working relationship needs to be developed. There is 
some degree of confusion in terms of the authority vested in the Chairman 
of the Council, his relationships with the top levels of Project manageiment, 
and the overall controls of the Project, The Chairman is very much dedicated 
to making the Project a success, but feels he needs a bit more clarification 
in defining his role function and authority level with regard to the Project. 
He is not suggesting another layer of management. On the contrary he is 
anxious to see the sites take on more responsibilities. It might be appropriate 
for the Federal sponsor to provide Mr. Machlkay on the OE position with 
respect to the Cour cil, especially in view of the impending legislation 
cited above. 
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F. Mini-reading tests 



Teachers and other HEED educators have recognized that the standardized 
achievement tests do not always represent a valid instrument for the 
Indian child, although there is no way to assess grade level growth 
without using such an instrument. In order to provide an alternative 
means of assessment which at the same time gave the child the feeling 
of a happy reading experience, SWCEL developed a special series of 
mini-reading tests where the reading passages were flavored with stories 
of interest for the children. 

The mini-tests require only 10 minutes to administer. 

The first series of mini-tests were given in December 1972. All sites 
participated excepting San Carlos Rice and Peach Springs. 

The results from this testing have been f Ur/l{ shed to Project management. 
It is gratifying to note that the children are cloing much better on the 
mini-reading tests, on the average, than -they did on the achievement te^sts. 
Whether the improvement is due to the shorter form of the test, the 
inclusion of culturally relevant materials^ or to general improvement 
in reading skills is not known. What is SignKicant is that the child 
is experiencing a degree of success in 9 reading task. 

The teachers have asked for more explan^^ of the rationale of the 
mini-reading tests and the nature of th*^ ^ . jcess evaluation which uses 
these tests. The Evaluator has provided this information to the Project 
Director. 

The second series of mini-reading tests have been given during the 
February 1973 period and will be reported in the next quarterly report. 

G. Plans for cultural awareness component 

As a result of the Council meeting held December 19th, and the agreement ' 
that cultural awareness would constitute a major Project objective area, 
the sites requested some type of guidelines for the structuring of this 
component. Through the efforts of Mrs Carpenter ,, a framework for suggested 
activities in the cultural awareness area was developed and furnished to 
Project management. These guidelines were subsequently distributed to the 
sites. While each site had some general idea of what to include in the 
cultural awareness unit, (and it was the wish of all site people that the 
local community share in the development), these separate plans had not been 
fully developed by the end of the quarter. Progress during the third quarter 
is highly encouraging. (The eouncil meeting in Topowa in January provided 
opportunity for individual site people to discuss their ideas with Mrs 
Carpenter). More about the implementation of the cultural awareness 
component and the assessment will be forthcoming in the next quarterly 
report. 
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H. Conferences with key people 



The Evaluator met with the Superintendent of the Sacaton schools 
on November 30th relative to Project problem areas as viewed from 
his position. This meeting followed by one day a meeting of the 
Superintendent with the Federal sponsor. 

The one major concern expressed by the Superintendent was for a 
successful Project. While not so stated, it was the feeling that he 
was concerned about the possibility of "over-management**. 

It was very gratifying to learn that one full time staff person would 
be added to the HEED staff. This addition would enable more close 
rapport at the site level. 

On the afternoon of November 30th, the Evaluator met with Dr. Hurd of 
the State Department of Education. This meeting served to clarify 
previous misunderstandings about last year's report, as well as an 
opportunity to share in the thinking of Project needs at the State 
Department level. 

One of the topics discussed was the preparation of an evaluation 
matrix so that program effects could be more readily assessed. The 
need for some means to determine program effects is recognized. This 
does bring back the matter of identifying other programs which are 
simultaneously operating at the sites. 

5. Rec ommenda t ions ' 



The following recommendations appear in order at this time: 

(1) clarify the role of top management as to who controls the 
project 

(2) Provide the Chairman of the Advisory Council with more specificity 
as to his role function. 

(3) Determine what to do about OLP at Many Farms 

(4) Increase site visitations as a means of keeping teachers and 
others abreast of new things, and as a primary source of feedback. 

(5) Provide for more classroom observations on reading and OLP, within 
the limitations of the budget 

(6) Continue monthly Council meetings 

(7) Encourage the site development of the cultural awareness units 
(8) Identify other program influences 

Orval D. Hughes, March 2, 1973 
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Special Evaluation Report 



Project HEED 



1 - Purpose 



The purpose of this report is to provide Federal sponsors of Project HEED 
with a timely, updated summary of Project accomplishments during the period 
January 1, 1973 thru March 15, 1973. 

This report has been requested by the Federal sponsors in order that they 
may have more complete information on Project activities and in that way be 
better prepared to make decisions relative to renewal funding. 

The importance of this report stems from a felt need by Federal sponsors 
that information received prior to the 3/12/73 meeting in Sacaton was 
insufficient to base funding decisions upon, and that they were unaware of 
several positive accomplishments within the Project. The response from tl.e 
Indian community in particular, at the 3/12/73 Sacaton meeting, clearly 
supported the continuation of the Project citing specific accomplishments 
and worthwhile current undertakings. For example , the President of the 
School Board of the Sacaton Schools stated that he would be willing to 
continue certain components of the Project at District expense upon final 
cut off of the Title III Project. 

L.. 

Neither the State Department of Education, Arizona or the Federal sponsors 
seemed adequately informed about the accomplishments of the Project, thereby 
suggesting a communications breakdown between these groups ^nd the Project 
management. The response by the above parties, upon recogiiiziiiig the deep 
concerns of the Indian community and the site representatives for cont iRiuation 
of the Project based upon positive accomplishments was most heartwarming. 

This represents the background which led to the suggestion by the Federal 
sponsors that this report be prepared. 

2. Period of report 

This report covers the period January 1, 1973 thru March 15, 1973. 

3 . Evaluation visits 

The Project Evaluator and/or his assistant have visited the following sites 
during the report period. 



Site 
Sacaton 
Sells/Topowa 
Hotevilla 
San Carlos Rice 
St . Charles Mission 



Date of visit 



.1/25/73 and 3/12/73 



1/26/73 
2/24/73 
3/11/73 
3/11/73 
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While these visits were planned in conjunction with scheduled meetings, 
( i.e. Advisory Council 1/26/73 & Federal sponsors 3/12/73), the visits did 
present an opportunity to visit classrooms and discuss Project activities 
directly with participating teachers. A total of 22 classrooms were visited 
during this report period. 

Direct visitations to the classroom to observe first-hand the progress of 
the children and the use of the eduontional materials, alongwith the chance to 
discuss the Project with the teachers is, in the opinion of the Evaluator, 
the most valid way to assess the Project. Using this criterion, the Project 
must be considered highly successful. 

As testimony of the feelings of key educators towards the Project, the 
Evaluator personally requested and received letters of support from the 
respective principals at St. Charles Mission and San Carlos Rice. These 
letters were addressed to the Superintendent at Sacaton, Mr. Wallace Burgess, 
who in turn passed them along to the Federal sponsor, Mrs Cassel at the 
3/12/73 Sacaton meeting. This somtiwhat indirect way of informing Federal 
sponsors was deemed necessary because of repeated heresay information of a 
totally negative nature towards the Project which has been eminating from 
upper sources. In fact, one such comment was' that the Federal sponsors had 
already met with State Department of Arizona officials and decided that the 
Project. was not to be continued. 

It is sincerely hoped that the Federal sponsors will not pre-judge the Project 
solely on information received from SDE Arizona but rather will examine care- 
fully all of the evidence, in particular the concerns of the Indian 
children, the actual accomplishments that are taking place, and the support 
for the Project which is evidenced by the educators at the sites and the 
Indian Advisory Council. 

4. The balance of this report will be subdivided as follows: 



Council meetings 
OLP institute 
Mini-reading 
Field trips 
Staff reports 

Conference with key officials 
Federal sponsor's meeting 



a. Advisory Council meeting 1/26/73 Topowa 

Minutes of this meeting have been distributed to the Federal sponsors 
in the dissemination packet provided at the 3/12/73 Sacaton meeting 
and are self-explanatory. It is significant to point out that each of 
the sites was represented at this meeting. St. Charles Mission, Hotevilla, 
and Topowa had completed their cultural awareness units as a follow-tip to 
the December Council meeting, and other site people discussed the development 
of their units with the SWCEL representative for the cultural awareness 
component, Mrs Carpenter. 

b. OLP institute 1/27/73 



A one day OLP institute designed to provide in-service training for 
participating teachers was held Saturday 1/27/73 at the Francisoo Grande 
in Casa Grande. 
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It should be stressed that proper implemontntlon of the SWCEL OLP 
includes providing Eor in-service training for the teachers/aides, 
Nortnally these in-service experiences are planned and conducted by the 
Quality Assurance Specialist. The nature of Project HEED with its scattered 
sites does not lend itself readily to such in-service meetings, though one 
staff member has completed all the requirements for QAS certification. 

Topics covered during the one day institute included: 

Content test adminis trat ion 
Interpretation of test data 
Lex icon/ pronunciation 
Syntax 

Regretfully, attendance was poor. The Peach Springs teachers were there, 
but there were no teachers from Sells, Sacaton, or San Carlos, It is 
understood that other conflicting in-service meetings from other Titled 
Projects prevented most of the participation. Project HEED staff was well 
represented. This brings back the point discussed in the 2nd Quarterly 
evaluation report. Identification of other influences in terms of Projects 
is essential before one can determine what the Program effects of HEED 
are , 

c. Mini- reading Progress 

The second set of mini-reading tests were administered during February 
1973, Children are consistently improving in reading skills. All sites 
participated excepting Sells, and there is no explanation why Sells 
did not complete the tests. 

Computer print-outs for the process evaluation covering the pre- test, 
first mini-reading and second mini-reading have been delivered to 
Project management and discussed. 

Discussions with several teachers at different sites and different grade 
levels testify that these instruments are well liked by the teachers and 
the children. 

The reader is reminded that a total time of 10 minutes is all that is 
required for administering the mini-reading test, and an assessment of 
vocabulary, synonym and comprehension is determined. These instruments 
are culturally relevant to the Indian child. 

It is also of interest to report that several other communities have 
begun using these mini-reading tests, and that in this vjay something 
started withim Project HEED has been replicated to other areas. Specific 
examples of such replication are with the Career Edu -^cion CenUerjTaos, 
South Valley Albuquerque schools, Ysleta Independen School District, Texas, 
Southern Pueblo Day schools, New Mexico, and recen'-iy an interest by the 
United Western Tribes of Oklahoma and Kansas, and the Burrough School District 
of Anchorage, Alaska. 

d* Field trips 

Again, this topic, is adequately covered in a hand-out furnished Federal 
aponsors at the 3/12/73 Sacaton meeting. One addition worthy of mention is 
the positive effort to relate the Globe , Arizona school system to the nature 
of the San Carlos Indian community, a Project which deserves commendable 
praise and sponsored by Mr, Bodiroga,7th grade teacher at San Carlos Rice. 



e. Staff visits and reports 

A separate report on this topic was included in the handout materials at 
the 3/12/73 Sacaton meeting. The only additional comment is that with 
someone of Mrs, Lujan's experience, ( over 30 years of teaching Indian 
children in BIA schools), it is a pleasure to note the very positive 
things described in h^r report. The Project management is to be commended 
for having employed such an eminently well qualified individual to the 
staff, 

f. Conferences 

Project evaluator and assistant met with the Chairman of the Indian 
Advisory Council on 2/24/73, Originally, a Council meeting was scheduled 
at Hotevilla but this was cancelled. Since SWCEL personnel were already 
in travel status it was felt that some gain could be realized by continuing 
with original ;lans. 

Mr, Machukay is very concerned about his role, and the role of the Council,- 
as it relates to the Project. There is a need for Federal sponsors to 
clarify the role of the Indian Advisory Council, There is growing concern, 
based upon the heresay threats that the Project would be discontinued, that 
the Federal sponsors and the SDE-Arizona are not listening to the Indian 
community. One way to smooth this matter out once and for all is to include 
representation by Mr, Machukay or his delegate to meetings where major 
Project affairs are being discussed. Another way to show interest is to 
c.ttend the Council meetings. Too many important matters regarding the 
Project are being discussed without the knowledge of the Indian Advisory 
Committee . 

The Evaluator has personally recommended to the Federal sponsor that some 
representation form the Indian Advisory Council be included - at the planning 
meeting in early April for re-writing the Project proposal. The exclusion 
of representation from this group can net lead to improvement in the 
current state of the relationships. 

A conference was held with Mr, Burgess on the morning of 3/12/73, and his 
concern was mainly the future of the Project, He too had received feedback 
that there was a strongly negative attitude pertaining to renewal, 

g. Federal sponsor's meeting 3/12/73 

The meeting had been originally scheduled for 3/11/73, then at 9:00 AM on 
3/12/73, and actually convened at 1:30 PM on 3/12/73, Attendance included 
Federal sponsors, SDE representation, Sacaton authorities. Project HEED 
staff. Community leaders, and SWCEL evaluation staff. 

Mr, Walker opened the meeting with a brief overview of Title III projects 
in general, and expressed his concern about the future of HEED, his attitude 
appearing at the time to be one of distrust of the Project and pessimism 
regarding its continuation. His factual back-up for this position stemmed not 
from actual site visitation reports, but rather from what he considered "scanty" 
information from Project management. 

Several ped'ple responded to this attack upon the effectiveness of HEED, citing 
specific accomplishments. The information contained dn the handouts, given out 
at the beginning of the meeting, would help materially in presenting a more 
favorable picture. 
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During the 2^ hour meeting the response from the site people, Indian 
community, school authorities. Project staff and evaluation staff was 
entirely positive. It is felt that the Federal sponsors and SDE representative 
came away from the meeting feeling much better about the Project. 

ThM'e is obviously work to be done to place the renewal proposal in proper 
format for acceptance by the Federal sponsors. 

One point that was clarif ied-name ly , who is in charge of the Project. 
The Superintendent, Sacaton Public Schools, by virtue of the nature of the 
Project, being funded under Section 306 of the Title III, was recognieed 
as the individual who is in charge of the Project. 

The meeting adjourned at approximately 4:00 P.M. 



Respectfully submitted, 
Orval D. Hughes " 

Project Evaluator March 26, 1973 
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TABLE I 

Mean Scores as Grade Equivalents 
Comparison by Sites 
Kindergarten 
Wide Range Achievement Test (Reading) 



Site N 

Many Farms 2 3 

(C) 29 

(O* 25 

Peach Springs 18 
Sacaton 

22 

San Carlos Rice 37 

Sells 22 

St. Charles 30 



Pre Post Gain 

K.l K.6 0.5 

K.5 K.9 0.4 

K.7 1.4 0.7 

K.4 K.6 0.2 

PK.3 K.5 1.2 

K.2 K.6 0.4 

K.2 K.4 0.2 

PK.9 K.8 0.9 

K.5 1.2 0.7 



Topowa ,. 17 K.l 1.1 1.0 

Tot^l 243 



*This class is a beginner's class, midway between Kindergarten 
and 1st Grade level. 



All classrooms are project classrooms excepting those identified 
as control (C) at Many Farms. 
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TABLE II 

Mean Scores as Grade Equivalents 
Comparison by Sites 
First Grade 



Site 

Many Farms 



Reading (WRAT) 

N Pre 

18 K.8 

(C) 22 1.4 

(C) 15 1.0 



Post 
1.4 
2.7 
1.5 



Gain 
0.6 
1.3 
0.5 



Peach Springs 



Sacaton 



San Carlos 



Sells 



11 
21 
19 
24 



K. 8 



K.8 



K.6 



K.6 



1.4 
1.3 
1.4 
1.5 



0.6 
'0.5 
0.8 
0.9 



St. Charles 



21 



1.7 



2.3 



0.6 



Topowa 



Total 



23 
174 



K. 8 



1.4 



0.6 



Control Classrooms identified by (C) . 
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APPENDIX E 



ERIC 



'i'houghts about Cultural Awareness 



Uhore are many definitions of culture but a simple one 
raicht be that culture consists of the material and social 
values of a group of people ^ their customs and mores, attitudes, 
and behavior patterns* 

Every individual at birth is surrounded by some pattern of 
norms which are transmitted to him in the learning process , 



beginning v/ith the parents and then the school. These norms 



differ from {^roup to group and also between people from 
different geographical sections here wibhin the United States. 

It should be clear that by "culture" we do not imply the 
connotation of cultivation or refinement. It makes no difference 
whether a person is a ditch-digger or a banker, each has his 
culture. The Indian child has a cultural heritage that is equally 
important to him as any other child *s culture might be. 

Culture has its material aspects and its non-material aspects. 
Tangible objects such as manufactured goods, raw materials, 
houses are examples of the material aspects of culture. Customs 
and mores, traditions represent the non-material aspects. Ve 
adapt our non-material culture to the material, and by cultural 
lag we refer to the situation where the material aspects of 
culture change at a more accelerated rate than the non-material. 
For example, we could easily adjust to a new style of automobile, 
but it is considerably more difficult to bring about a change 
in the non-material aspects of culture, such as a reform in the 
educational process. 
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'iMie /mc'lo cul';iirc has advanced /imerica in the technolot:;ical 
sense ^ and yet because of the cultul7al lag, the Anglo has 
not realized a correspondinp; development in non-material 
areas • Everyday problems such as accident prevention, nlum 
clearance, pollution illustrate that we are behind the times 
iiociologically^ The Indian culture places considerably more 
stress on balancing the material and non-material aspects 
of cultxire than does the Anglo • 

In developing a cultural awareness component for Project 
HEED, involvement with the community is highly recommended* 
Each tribe will know best what norms indeed represent the 
significant bases for their cultural beliefs • Here are some 
suggested areas which might be included in a model for a 
cultural awareness component* 

I0 Speech 

What are the languages, writing systems if any, and 
communication patterns ? 

2# Material Traits 

a* Food habits, and how obtained 

b. Shelter 

C0 Transportation and travel 

d* Dress 

.e# Tools/ utensils 

V/eapons 

g# Occupations 

5 • /trt 

a • Carvings/Paintings/Drawings/Music/Dances etc • 




4. Legends, mythology, and tribal history 

5# Religious pr£\c bices 

a. ritual isiQ (i.e. Zuni Shalako) 

b. Treatment of the sick 

c. Treatment of the dead/burial 

6. Family and Llocial Systems 

a. Forms of marriage 

b. Methods of reckoning relationship 

c. Inheritance 

d. Authority figure 

e. hJocial controls/ tabooi^' folkways/customs/mores 
f • Sports and games 

7 . Property 

a. Real and personal 

b. Standards of value and exchange 

c . Trade 

8. Government 

a. Tribal organization 

b. Judicial and legal procedures 

9. Affiliations 

a. Relationships vjith other tribal groups 

b. iirolationships v/ith other ethnic groups 

10. Leadership 

a. Examples of tribal leaders 

Somewhere the conflicts between the Indian culture and the iVnglo 
culture should be included* (i.e. Time orientation^ etc.) 



Maudine Carpenter 
December 28, 1972 
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APPENDIX G 



ERIC 



al;:-Jvuerqu£ pueijc schools 



ALBUQUERQUE. NEW MEXICO 



EMSRSOiNi El.EMENTAf^Y SCHOOL 



fl.'iO Ojro^VJiA kit.. fJIK 



ROY MAUONE. 

PKINCIPAU 



RECEIVED 



SWOEL 

2017 Yal^, S.H. 
Albq,, 



W. C. E L 



JUN 11 A.M. 



ATTEN T ION : gl.i,„,0 1„ Pr^:}ect HEED 



D ear Br « f I iif^fe e s : 

Tae :f ia \-o^pi.5rt the attitudes we eaceimtercd 
' x-yi'^rivds t'r^i^jeo i: Heed duri.^ig nniX" recant trij") Sa^o. Garl©s aad 
Saca-tess. Indian. Ro^;ervati'i5j?.s to peri«5X'2fi testing tasks relative 
t«^ tiJie pr^Dgra^n., 

V/itk@ut exceptl(;>iri we found tifee attitxit^es ©f tke teachers 
"tsi be pc^^c-^i tiY^5 with :rf:garti t-^} tfee iiae of tke Difs'tar materiala 
pri^>vidonil by tfee oragrajnu T'key said tiieae we7:e ©f great "beaefit 
tf* tk?.^ I^ridiajia c>ij:i Idre>i> in the teackxBg- of reading, and «ur ^wsl 
^^bservaiii^viiia durijig the testiug prnscecUire:^ c©:afiriaed their 
s&?pi7ii«j«is . At Sari O^.rl^os Reservatio.!^ ^ tv/<^ sther first-grade 
ti!;ac'sic-r3 expressed i.^,ta,re3t in bel^ag inolueled i:». tke program 
asd 'Wi^irt'^d their atudei^-its to be test^^ti^ sri^vce tkey kad kad s©rae 
exposure. t'i5 tba Distar ^ ir.aterial.? . TJnf <»rtimately 9 we were unable 
b^? acv;iji'mEjdat6 tkert} iia tkis request, r-3i.jice \vt* easily ha^^ witk ub 
tke nvvitrcu-ia'.i/? requir-sd for testi.>ig tfevi>3e p.lready in tke program. 
V/a advised theiia t*^ rj.'^xer their requeats thrsjugk tkeir priaicipal 
f^^r pv9S3ible future aside ration. 

There wa.s s^m*^ discojTitent evide.taced- at Sa^a Carl®s Rio<i " 
witk rcrrcarci tke fact tkat SfS^Ee teachers kad met r<^ceived a 
r^?:p^ri: ^^i the :'5C^reo from l:v-:t P^ill^ but tkis tursted ®ut t® be 

pr35blai:r5 -^^f iiatr ibuti^js witkiH tke sck^ol^ siMce tke scares 
J^ad baen i/i'r?::'?i tc* a repren^^mtatiTa tke sck©©l* 

O.^krv^ugk0ut ©ui* stay at b^tk reser^'-ati^^as we were givea to 
uiiiddrs t.aj»-4 tkat tkere was 'sm^e disc^Jiiter^t ©ver tke. fact tkat tke 
I^adiai^. Advis«^C'y Ct^uaoil kad ^^t be^am ii?Lcluded i:a. tke rewritiiag 
^£ tke Project Haed .Vr^grao^^ ^ , ^ 
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